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ABSTRACT 

An  experimental  investigation  of  super-resolution  imaging  from  measurements  of  projections  onto  a  random 
basis  is  presented.  In  particular,  a  laboratory  imaging  system  was  constructed  following  an  architecture  that 
has  become  familiar  from  the  theory  of  compressive  sensing.  The  system  uses  a  digital  micromirror  array 
located  at  an  intermediate  image  plane  to  introduce  binary  matrices  that  represent  members  of  a  basis  set. 
The  system  model  was  developed  from  experimentally  acquired  calibration  data  which  characterizes  the  system 
output  corresponding  to  each  individual  mirror  in  the  array.  Images  are  reconstructed  at  a  resolution  limited 
by  that  of  the  micromirror  array  using  the  split  Bregman  approach  to  total-variation  regularized  optimization. 
System  performance  is  evaluated  qualitatively  as  a  function  of  the  size  of  the  basis  set,  or  equivalently,  the 
number  of  snapshots  applied  in  the  reconstruction. 


1.  INTRODUCTION 

The  field  of  digital  super-resolution  has  matured  steadily  over  the  last  couple  of  decades,  with  a  variety  of 
algorithmic  approaches  proposed  and  demonstrated.  Digital,  or  reconstruction-based  super-resolution,  usually 
refers  to  the  reconstruction  of  a  high-resolution  image  from  multiple  low-resolution  images,  where  the  resolution 
of  the  reconstructed  image  exceeds  the  detector-limited  resolution  of  the  imaging  system.  One  of  the  earliest 
references  on  that  topic  is  attributed  to  Tsai  and  Huang.1  Digital  super-resolution  relies  on  the  presence  of 
spatial  aliasing  in  the  low-resolution  images. 

Digital  super-resolution  is  limited  by  the  optical  resolution  of  the  imaging  system  used  to  acquire  the  low- 
resolution  frames,  but  additional,  more  strict  limitations  on  attainable  resolution  exist. 2~4  The  extent  of  limits 
on  super-resolution  remains  to  be  fully  explored.  Despite  these  limits,  commercialization  of  super-resolution 
has  been  occurring  with  a  number  products  appearing  on  the  market.  The  vast  majority  of  prior  research  and 
development  has  occurred  on  the  algorithmic  side  of  the  technology.  Far  fewer  examples  exist  of  cameras  designed 
specifically  with  the  capability  of  producing  super-resolved  images  as  an  objective.  These  include  cameras  with 
image  sensors  that  acquire  multiple  shots  while  the  sensor  physically  shifts  between  shots.5,6  As  technology 
advances  and  the  interest  in  imaging  systems  that  take  advantage  of  and  even  enable  super-resolution  grows,  it 
becomes  increasingly  important  to  understand  the  limitations,  how  to  mitigate  those  limitations,  and  how  it  all 
impacts  choices  in  system  design  will  become  increasingly  more  important. 

We  present  a  compressive  sensing  image  system  designed  for  super-resolution:  the  Adjustable  Resolution 
Compressive  Sensing  Imager  (ARCSI).  This  ARCSI  sensing  model  is  designed  for  the  held  of  remote  sensing, 
where  both  the  sensor  and  the  target  may  be  moving.  Compressive  Sensing  (CS)  is  a  methodology  recently 
introduced  that,  among  other  goals,  strives  to  make  efficient  use  of  sensor  resources.  Due  to  its  novelty  and 
potential,  the  interest  in  compressive  sensing  has  steadily  risen  since  the  seminal  papers  of  the  mid-2000s.'’8 
CS  presents  entirely  new  ways  to  capture  images  that  results  in  more  efficient  sampling  and  a  corresponding 
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reduction  in  the  amount  of  data  required  to  capture  the  salient  information  in  a  signal.  A  recent  application  of 
CS  to  super-resolution  is  the  simulations  of  Marcia  and  Willet.9  Their  method  modulates  the  Fourier  transform 
of  the  signal  while  the  ARCSI  modulates  purely  in  the  spatial  domain. 

In  traditional  sensing,  capturing  a  grayscale  image  with  N  pixels  requires  N  measurements.  For  the  sake  of 
conversation,  suppose  those  N  measurements  corresponded  to  N  bytes  of  data.  In  order  to  store  or  transmit 
that  same  image,  we  typically  compress  it  to  a  fractional  number  of  bytes  K  «  N  with  minimal,  or  even  no, 
visible  loss.  This  suggests  that  traditional  imaging  is  non-optimal,  since  we  had  to  collect  N  bytes  of  data  to 
get  K  bytes  of  information.  Ideally,  we  would  collect  the  K  essential  measurements  at  the  start,  thus  reducing 
sensing  costs  in  the  form  of  energy,  equipment,  and  time.  Of  course,  compression  relies  on  the  fact  that  we  have 
gathered  the  full  image  and  can  then  decompose  that  image  into  a  basis  in  which  it  is  sparse  (e.g.  a  wavelet  or 
a  cosine  basis).  The  surprising  result  of  CS  is  that  we  do  not  need  to  collect  the  full  N  bytes  of  data.  CS  theory 
shows'’8  that  while  we  cannot  get  away  with  only  K  measurements,  for  certain  appropriate  measurements,  we 
only  need  a  number  of  measurements  that  grow  as  O  {K  log  (^))  •  In  addition,  we  can  do  this  without  choosing 
ahead  of  time  the  basis  that  best  represents  the  image. 

In  order  to  improve  upon  traditional  sensing,  CS  requires  a  restricted  set  of  measurements  that  correspond 
to  matrices  satisfying  what  is  called  the  Restricted  Isometry  Property  (RIP).7  Determining  whether  a  given 
sensing  matrix  satisfies  RIP  is  known  to  be  an  NP-complete  problem.10  However,  it  is  also  known  that  Bernoulli 
and  Gaussian  matrices  make  up  a  useful  collection  of  sampling  matrices  that  have  a  very  high  probability  of 
satisfying  RIP. 

Rice’s  single  pixel  camera11  demonstrates  one  of  the  first  applications  of  CS  theory  to  gray-scale  imaging. 
Benefits  of  this  architecture  include  a  combination  of  lower  cost,  higher  information  efficiency  and  flexibility  in 
sensor  application.  The  camera  uses  a  single  photodetector  and  a  Digital  Mirror  Device  (DMD)  to  implement 
random  matrices  that  have  been  shown  to  meet  CS  requirements.  By  selecting  random  patterns  with  the  mirrors 
that  block  half  incoming  light,  each  measurement  by  the  detector  gathers  the  total  light  from  half  of  the  scene. 
Rapidly  changing  the  pattern  with  each  measurement,  at  roughly  twelve  thousand  times  per  second,  allows 
gathering  sufficient  data  to  reconstruct  the  image  plane.  The  camera  is  an  impressive  demonstration  of  how 
CS  might  be  applied  to  practical  sensing  devices,  but  it  is  not  well  suited  to  remote  sensing.  The  sensor  trades 
number  of  detector  elements  for  collection  time,  and  while  CS  allows  the  sensor  to  get  away  with  far  fewer 
measurements  than  traditional  sensors,  it  still  requires  enough  measurements  that  would  make  it  impractical  for 
a  moving  platform  imaging  objects  that  might  be  moving  themselves. 

Inspired  by  the  single  pixel  camera,  we  apply  Bernoulli  sensing  matrices  and  DMDs  to  a  more  traditional 
sensing  architecture  in  an  attempt  to  boost  the  imaging  system’s  resolution.  Our  goal  is  to  use  the  optimal 
sensing  of  CS  to  boost  the  imaging  system’s  resolution.  The  new  system,  ARCSI,  has  a  detector  array  that  does 
not  fully  resolve  the  smallest  length  scales  captured  by  its  optics,  and  a  DMD,  with  a  higher  resolution  than  the 
detector.  We  increase  image  resolution  by  taking  multiple  low-resolution  snapshots,  each  with  a  unique  random 
binary  pattern.  We  then  solve  an  inverse  problem  to  reconstruct  an  image  with  a  number  of  pixels  equivalent  to 
number  of  mirrors  in  the  DMD,  see  Fig.  2.  Although  our  device  uses  a  DMD,  a  set  of  fixed  coded  apertures  could 
be  used,  and  indeed  would  be  more  practical  for  imaging  with  just  a  couple  of  snapshots.  A  useful  property  of  the 
ARCSI  is  that  any  single  snapshot  can  stand-alone  as  a  low-resolution  image.  Acquiring  additional  information 
then  allows  the  user  to  enhance  resolution  as  needed. 

The  ARCSI  sensor  has  the  potential  to  be  useful  within  the  general  constraints  of  remote  sensing,  and  in 
the  process  has  expanded  our  understanding  of  how  the  physical  realities  of  implementing  a  sensor  interfere 
with  achieving  many  of  the  desired  theoretical  assumptions.  In  the  next  section  we  describe  the  experimental 
setup  and  computation  of  the  sensor  forward  model.  Next  we  briefly  outline  the  reconstruction  method  for 
inverting  the  compressive  sensing  operator.  Experimental  results  are  provided  as  a  qualitative  assessment  of  the 
super-resolution  performance,  followed  by  what  we  have  concluded  from  the  research. 

2.  SENSOR  SETUP  AND  MODEL 

The  basic  design  of  ARCSI  has  a  lot  in  common  with  previous  demonstrations  of  compressed  sensing,  and  in 
particular,  the  seminal  work  of  Duarte  et  al.11  and  Marcia  and  Willet.9  The  primary  difference  is  that  ARCSI 


uses  a  full  CCD  array,  as  opposed  to  an  individual  detector  or  a  small  set  of  individual  detectors  and  modulates 
exclusively  in  the  spatial  domain.  As  a  result,  a  single  snapshot  with  ARCSI  gives  a  recognizable  image.  The 
DMD  is  only  used  to  increase  resolution. 

Fig.  1  illustrates  the  2  imaging  arms  of  the  ARCSI  system  configuration.  In  the  scene  arm,  a  field  lens  (Lens 
1  in  the  figure)  is  used  to  form  an  intermediate  image  of  the  object  plane,  or  scene,  onto  the  DMD.  The  sensor 
arm  then  relays  the  intermediate  image  by  using  an  eye  lens  (Lens  2)  to  image  the  DMD  onto  a  CCD  sensor. 
Specifications  for  the  DMD  are  summarized  on  the  manufacturer’s  website.12  ARCSI  selected  a  combination  of 
vendors’  stock  lenses  using  optical  modeling.  The  scale  of  the  setup  was  constrained  to  fit  on  a  6'  x  4'  optical 
table. 


Figure  1:  Diagram  illustrating  the  experimental  setup  used  to  acquire  ARCSI  data.  Lens  1  forms  an  image  of 
the  object  plane  on  the  DMD  which  is  spatially  coded  with  a  binary  pattern.  Lens  2  then  forms  an  image  of  the 
object  plane  multiplied  by  the  binary  pattern.  Note  that  the  figure  is  not  to  scale. 

As  Fig.  1  illustrates,  in  the  sensor  arm  the  DMD  is  tilted  with  respect  to  the  optical  axis.  This  is  required  in 
order  to  focus  the  intermediate  image  on  the  DMD  across  the  entire  held  of  the  CCD.  The  angle  of  the  optical 
axis  for  the  sensor  arm  with  respect  to  that  of  the  scene  arm  is  fixed  by  the  angle  (0  in  the  figure)  at  which  the 
DMD  micro-mirrors  tilt  when  in  the  “on-state.”  The  eye  lens  is  positioned  normal  to  the  optical  axis  for  the 
sensor  arm.  The  angle  of  the  CCD  then  is  set  according  to  the  Scheimphug  principle  which  directs  that  the  focus, 
lens  and  object  planes  (which  in  this  case  is  the  plane  of  the  DMD)  will  simultaneously  intersect  on  a  line.13  In 
addition  to  this  tilt,  the  DMD  is  also  rotated  45°  around  the  normal  to  it’s  surface.  This  rotation  is  introduced 
so  that  the  micromirrors,  which  tilt  about  their  diagonals,  will  deflect  rays  incident  from  the  object  in  the  plane 
of  the  optical  table.  The  CCD  is  also  rotated  about  it’s  normal  to  maintain  the  same  geometry  as  the  DMD. 
Custom  mounts  were  designed  and  fabricated  for  the  DMD  and  the  camera  to  establish  this  configuration. 

An  Andor  Luca-R  electron  multiplication  CCD  (EMCCD)  camera  was  used  to  acquire  the  data.  EMCCDs 
offer  the  advantage  that  gain  can  be  applied  to  the  data  prior  to  readout,  thus  avoiding  amplification  of  read 
noise.  Low-noise  sensor  options  are  appealing  because  reconstruction  algorithms  used  in  compressive  sensing, 
including  the  one  described  in  Sect.  3,  tend  to  degrade  when  noise  is  introduced  in  the  data.  Specifications  for 
the  Luca-R  are  given  in  Table  (1).  The  quantum  efficiency  of  the  device  is  well  over  50%  for  most  of  the  visible 
spectrum.  The  camera  contains  a  thermoelectric  cooler  and  operates  at  -20  °C  to  reduce  thermal  noise.  The 
CCD  and  Lens  2  were  positioned  to  achieve  a  magnification  corresponding  to  approximately  one  DMD  mirror  to 
each  CCD  pixel.  As  will  be  discussed  below,  the  data  is  down  sampled  by  binning  4x4  pixels  to  simulate  a  low 
resolution  sensor,  see  Fig.  2.  This  results  in  approximately  4x4  micromirrors  to  each  effective  low-resolution 
CCD  pixel.  Down  sampling  in  software  is  useful  because  it  allows  us  to  study  the  effects  of  various  ratios  of 


mirrors  to  detector  elements  in  a  laboratory  setting.  Because  of  the  distortion  introduced  by  the  tilted  planes  of 
the  CCD  and  DMD,  it  was  not  possible  to  attain  that  magnification  across  the  field.  It  was  also  not  feasible  to 
establish  exact  registration  between  micromirrors  and  pixels.  Binary  patterns  are  written  to  the  DMD  through  a 
computer  interface.  Given  the  setup  shown  in  Fig.l,  the  image  incident  on  the  CCD  is  then  the  product  between 
the  scene  image  and  the  pattern  displayed  on  the  DMD. 
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Detector 

=m 
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Mirrors  (DMD)  Actual  Detector 


Figure  2:  Sensor  schematic  showing  the  relative  magnification  between  DMD  and  detector  plane  (1:2)  and  then 
the  software  down-sampling  operation  effectively  making  the  compression  ratio  from  DMD  to  effective  detector 
as  16  :  1.  This  configuration  allows  the  study  of  various  ratios  of  mirrors  to  detector  elements. 


Active  Pixels 

1004  x  1002 

Pixel  Size  (pm) 

8x8 

Image  area  (mm) 

8x8 

Active  area  pixel  well  depth 

30000 

Gain  register  pixel  well  depth 

80000 

Max  readout  rate  (MHz) 

13.5 

Frame  rate  (per  second) 

12.4 

Read  Noise  (e~ ) 

<  1  to  18  @  13.5  MHz 

Table  1:  Andor  Luca  R  specifications. 


To  successfully  perform  super-resolution,  we  need  an  accurate  sensor  forward  model  mapping  high  resolution 
images  to  ARCSI  measurements.  For  our  purposes,  we  only  need  to  model  the  DMD  to  detector  arm  of  the 
sensor,  resulting  in  reconstructions  with  a  number  of  pixels  determined  by  the  size  of  the  DMD.  Accurately 
modeling  the  performance  of  ARCSI  requires  measuring  the  system  response  to  each  individual  mirror  on  the 
DMD.  We  do  this  by  imaging  fiats  with  every  tenth  mirror  turned  on  along  both  axes.  We  shift  the  pattern  of 
activated  mirrors  through  100  images  to  account  for  all  mirrors.  A  single  image  from  this  calibration  process  is 
illustrated  in  Fig.  3. 

As  with  any  CCD-based  detector,  before  any  processing,  all  calibration  data  requires  correction  to  remove 
any  detector  artifacts.14  We  remove  scattered  light  and  dark  current  by  subtracting  a  frame  collected  with  the 
light  source  on  and  setting  all  of  the  mirrors  to  the  off  state.  This  frame  is  collected  using  the  same  exposure 
times  as  the  calibration  data.  Finally,  we  apply  a  multiplicative  flat  field  correction  for  the  differences  in  pixel-to- 
pixel  response,  gain  variation  across  the  detector,  and  field  illumination.  These  correction  frames  are  all  median 
combinations  of  many  frames  of  each  type  which  we  measure  at  start  of  a  collection  run. 

The  ARCSI  sensing  matrix  A  for  a  single  snapshot  depends  on  0,  the  transfer  function  between  DMD  mirrors 


Figure  3:  One  frame  of  a  typical  ARCSI  calibration.  The  left  image  is  the  input  to  the  DMD  while  the  right 
image  is  the  response  on  the  detector.  The  zoom-in  shows  the  size  of  the  psf.  Matching  the  pixel  on  the  left 
with  a  patch  on  the  right  allows  us  to  build  a  precise  linear  model  for  the  camera. 


and  the  detector  that  is  built  from  the  calibration  data,  a  masking  operator  A  determined  by  the  pattern  of 
activated  DMD  mirrors,  and  a  downsampling  operator  D: 


A  =  D  AO. 


(1) 


Given  a  DMD  state  B,  where  B  is  a  binary  array,  we  place  the  values  of  B  onto  the  diagonal  of  a  very  large 
sparse  array  A.  Finally,  we  apply  a  down-sampling  operator,  D,  which  takes  each  group  of  4  x  4  pixels  on  the 
detector  and  produces  a  single  average  of  those  16  pixels. 

The  sensor  matrix  for  multiple  snapshots  is  created  by  tiling  single-snapshot  matrices  for  a  collection  of  DMD 
patterns,  Bi,  B2, . . . ,  B^,  and  corresponding  diagonal  matrices  Ai,  A2, . . . ,  A^: 


A  = 


D  Ai  0 
D  A2  0 


DAlO 


(2) 


The  data  acquired  consists  of  a  set  of  low-resolution  measurements  from  random  inner-products  on  a  local  level. 
The  masks  are  drawn  from  a  uniform  random  distribution  with  the  constraint  that  each  4x4  block  has  precisely 
8  mirrors  turned  on  and  8  turned  off. 


3.  RECONSTRUCTION 

Underdetermined  inverse  problems  have  gained  quite  a  bit  of  interest  in  the  last  decade  and  are  increasingly 
available  to  users  as  convenient  software  packages. 15-17  The  goal  of  this  project  explicitly  involves  demonstrat¬ 
ing  a  realistic  implementation  of  a  CS-like  camera  for  flexible  remote  sensing.  We  therefore  do  not  concentrate 
on  optimizing  the  reconstruction  method,  parameter  space,  or  reconstruction  time.  There  is  far  more  research 


that  could  be  conducted  to  determine  effective  reconstructions  for  the  ARCSI,  including  learned-dictionary 
regularization18, 19  or  Bayesian  methods.20  The  most  effective  reconstruction  methods  used  total-variation  regu¬ 
larization.21,22  Promising  reconstructions  were  also  found  by  balancing  the  total- variation  against  a  smoothing 
wavelet. 

3.1  Split  Bregman:  total  variation  and  wavelet  regularization 

Let  A  be  the  ARCSI  linear  sensor  model.  Suppose  that  u  £  is  a  high-resolution  image  with  N  pixels.  Then 
A  maps  u  onto  a  sample,  y  =  Ait.  The  goal  is  to  take  A  which  is  given  (or  in  our  case  measured  from  the 
sensor  directly)  and  the  sample  y,  which  is  a  collection  of  M  low-resolution  measurements,  and  come  up  with 
the  correct  high-resolution  image  u.  Since  M  <  N  the  inverse  problem  is  underdetermined  and  therefore  we 
need  to  regularize  the  optimization  problem  to  select  one  answer  from  the  infinite  dimensional  null-space  of  A. 
We  settled  on  the  following  problem  statement: 

u*  =  argmin  ||Au  —  y\\Z  +  Ai  I  |W_1u|  I  +  A2  ||Vii||,  ,  (3) 
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where  W  is  a  wavelet  transform  with  coefficients  a  =  W_1u. 

Equation  (3)  with  Ai  =  0  tends  to  produce  reconstructions  with  sharp  contrasting  edges  while  smoothing 
regions  of  low  contrast.  Thought  to  be  nearly  optimal  for  cartoon-like  images,  the  results  can  appear  like  an 
oil  painting  if  the  sampling  operator  is  severly  undersampled.  Equation  (3)  with  Ai  >  0,  A2  >0  allows  more 
smooth  structures  to  be  reconstructed.  For  most  imagery  that  we  investigated,  Equation  (3)  produced  better 
reconstructions  with  Ai  =  0  while  a  small  percentage  of  imagery  responded  well  to  the  wavelet  regularization  by 
allowing  Ai  >  0.  In  either  case,  we  used  a  split-Bregman  implementation22  to  quickly  solve  the  inverse  problems. 
This  involved  using  few  outer  iterations  and  many  inner  iterations. 

4.  RESULTS 

In  the  following  section,  we  present  a  series  of  results  from  data  acquired  and  processed  during  the  experiments 
described  above.  These  results  qualitatively  demonstrate  super-resolved  images  from  groups  of  detector-limited 
images  projected  onto  a  random  binary  basis  set.  In  each  collection  of  results,  we  provide  examples  of  images 
reconstructed  using  as  few  as  two  and  as  many  as  16  snapshots  to  illustrate  the  tradeoff  between  image  quality 
and  the  amount  of  data  required  to  reconstruct  the  associated  images.  The  first  of  these  results  is  presented 
in  Fig.  4  and  corresponds  to  images  from  a  standard  resolution  target.  The  image  on  the  far  left  and  labeled 
low-res  is  a  single  image  acquired  with  all  of  the  DMD  mirrors  switched  to  the  on  position,  and  then  down 
sampled  by  binning  pixels  on  the  CCD  in  4  x  4  blocks.  We  preserve  subsets  of  masks,  so  the  reconstruction  using 
16  snapshots  has  the  same  8  masks  from  the  8  snapshot  reconstruction  and  8  additional  snapshots.  The  same 
relationship  exists  between  8  and  4  snapshot  reconstructions. 

The  smallest  set  of  bars  have  roughly  3  times  the  spatial  frequency  as  the  largest  full  set  of  bars.  This 
visually  confirms  the  increase  of  resolution  to  roughly  3x  between  the  low-resolution  image  and  the  16  snapshot 
reconstruction.  An  argument  can  be  made  that  the  total  variation  method  of  image  reconstruction  can  artificially 
sharpen  a  binary  image  with  well  defined  edges  such  as  the  images  represented  in  Fig.  4.  To  address  that  concern, 
two  additional  examples  are  provided  in  Fig.  5  and  Fig.  6.  In  Fig.  5,  the  object  corresponds  to  a  small  region  of 
a  dollar  bill  with  it’s  associated  fine  spatial  details.  Much  of  that  detail  is  lost  in  the  single  low-resolution  image 
represented  on  the  left.  As  we  move  from  left  to  right  in  the  figure  and  additional  snapshots  are  included  in  the 
reconstruction,  qualitative  improvements  can  be  seen  in  the  images.  Note  that  these  images  have  been  processed 
using  the  same  method  applied  in  Fig.  4.  To  reiterate,  these  improvements  come  at  the  expense  of  additional 
data  collection,  storage,  and  processing. 

The  final  example  we  present  is  shown  in  Fig.  6  in  which  the  object  is  an  overhead  photograph  of  an  airport. 
This  example  demonstrates  how  the  level  of  object  discrimination  is  increased  when  additional  snapshots  are 
included  in  the  reconstruction.  For  illustration,  we  have  highlighted  a  vehicle  in  the  lower  part  of  the  image  with 
a  circle.  In  the  low-resolution  representation,  the  vehicle  is  detectable  but  otherwise  unrecognizable  at  any  higher 
level  of  discrimination.  As  more  snapshots  are  added  to  the  reconstruction,  spatial  details  begin  to  emerge  until 
the  object  is  recognizable  as  a  vehicle.  Other  evidence  of  increased  resolution  can  be  found  in  the  images  as  well. 
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Figure  4:  An  example  of  images  reconstructed  from  2-16  snapshots  using  the  approach  described  in  Sect.  2.  The 
image  on  the  left  represents  a  single  down  sampled  acquired  with  all  mirrors  on  and  then  binning  the  detector. 
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Figure  5:  An  example  using  a  grayscale  object  with  fine  spatial  details.  Qualitative  improvements  in  the  image 
resolution  are  visible  as  additional  snapshots  are  included  in  the  reconstructions. 
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Figure  6:  In  this  example,  the  object  is  an  overhead  photograph  of  the  Zurich  airport  (terminal  B)  taken  with 
Quickbird  sensor  via  Google  Earth.  The  ability  to  discriminate  the  vehicle  (highlighted  in  the  circle)  improves 
as  the  number  of  snapshots  increases. 


5.  CONCLUSIONS 

In  this  paper,  we  have  experimentally  demonstrated  image  super-resolution  from  a  tabletop  imaging  sensor 
inspired  by  previous  demonstrations  in  compressive  sensing.  In  particular,  the  sensor  described  here  acquires 
images  projected  onto  a  subset  of  a  random  binary  basis,  but  performs  that  acquisition  on  a  CCD  as  opposed 
to  a  single  detector  or  small  collection  of  detectors.  The  approach  presented,  including  the  method  chosen  for 
image  reconstruction,  was  motivated  largely  by  remote  sensing  as  an  application  and  the  interest  in  an  alternative 
super-resolution  solution  suitable  for  that  application. 

Three  sets  of  reconstructed  images  were  presented  corresponding  to  data  acquired  from  three  different  subject 
matters  representing  a  range  of  characteristics  from  simple  binary  to  grayscale  with  varying  levels  of  spatial  detail. 
In  each  of  these  examples,  super-resolution  was  successfully  demonstrated  to  varying  degrees.  Also  provided  by 
the  results  is  a  qualitative  study  of  how  the  resolution  of  the  reconstructed  images  improves  with  the  number 
of  projections  used  in  the  reconstruction.  Given  that  more  snapshots  equate  to  the  collection  of  more  data, 
the  study  highlights  the  fundamental  tradeoff  between  image  resolution  and  data  volume.  By  furthermore 
acknowledging  a  relationship  between  resolution  and  information,  the  tradeoff  between  resolution  and  data  can 
be  translated  to  a  tradeoff  between  information  and  data.  And  while  a  resolution/information  gain  is  evident 
in  the  results  presented,  we  cannot  conclude  from  these  results  alone  whether  or  not  there  is  any  information 
efficiency  advantage  to  this  approach. 
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